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1 DATA STREAM CONTROL SYSTEM FOR ASSOCIATING COUNTER 

2 VALUES WITH STORED SELECTED DATA PACKETS FROM AN 

3 INCOMING DATA TRANSPORT STREAM TO PRESERVE INTERPACKET 

4 TIME INTERVAL INFORMATION 

5 

6 Background of the Invention 

7 Field of the Invention 

8 The present invention is directed to information storage and display systems 

9 utilizing storage devices, and more particularly, to video recording systems that store and 
10 playback streaming video data packets. 

11 

12 Description of the Related Art 

13 Audiovisual information is advantageously compressed by audiovisual data 

14 storage systems, thereby expressing the information by using less data. Compression 

15 reduces the amount of storage needed for a given amount of source material, and it 

16 reduces the bandwidth needed for the transfer of the data. One standard for audiovisual 

17 compression is MPEG (Moving Picture Experts Group) compression which was 

18 developed by a joint technical committee of the International Organization for 

19 Standardization (ISO) and the International Electrotechnical Commission (lEC). The 

20 MPEG compression standard is outlined in "Information Technology: Generic Coding of 

21 Moving Pictures and Associated Audio Information: Systems," International Standard 

22 ISO/IEC 13818-1:1996 (E), which is incorporated by reference herein. 

23 For the transmission of audiovisual programming, various programs transmitted 

24 from the outputs of various MPEG encoders are multiplexed together into a transport 

25 stream, the transport stream comprising multiple series of fixed-size data packets, along 

26 with metadata which describes the transport stream. Each data packet comprises a 

27 header and a payload. The header contains various information regarding the data 

28 packet, including the packet identifier code (PID) which identifies the program or data to 

29 which the data packet belongs. The metadata includes a program association table 

30 (PAT) that lists the various programs comprising the transport stream and points to a 
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1 program map table (PMT) that lists the corresponding data packets. The metadata can 

2 also include conditional access information (i.e., encryption). 

3 The different series of data packets of the transport stream are generally 

4 generated by different MPEG encoders, which typically have different compression 

5 factors and different system time clocks (STCs). The different system time clocks 

6 generally are not synchronized to one another. In changing from one program to the 

7 next, an MPEG decoder synchronizes its STC with the STC which was used during the 

8 encoding of each program. This synchronization avoids jitter in the decoded data 

9 stream, and avoids overrun or underrun of the memory buffers of the MPEG decoder, 

10 To provide the synchronization data needed to decode a series of data packets, the data 

1 1 packets are encoded with program clock reference (PGR) information. 

12 During the encoding of audiovisual data, a fixed-frequency (e.g., 27 MHz) STC 

13 of an MPEG encoder drives a constantly running binary counter, the value of which is 

14 sampled periodically and placed in the data packet headers as PGR information. At the 

15 decoder, the PGR value of a data packet is compared with a local PGR value which is 

16 driven by a STG with nominally the same frequency. The difference in these PGR values 

17 (the PGR phase error) thereby allows the MPEG decoder to properly synchronize its 

18 STG to the STG of the MPEG encoder for the selected series of data packets, thereby 

19 duplicating the same frame rate used at the MPEG encoder with the frame rate generated 

20 at the MPEG decoder. Note that because the timing of the presentation of these PGR 

21 values at the MPEG decoder is critical for the MPEG decoder to operate correctly, this 

22 PGR method relies on the MPEG decoder receiving the series of data packets for a 

23 particular program with the same interpacket time intervals as the series of data packets 

24 had when they were transmitted from the MPEG encoder. 

25 U.S. Patent No. 5,467,137 issued to Zdepski, which is incorporated by reference 

26 herein, addresses the problem of varying transmission times among a series of data 

27 packets being transmitted across a system such as the Internet. Zdepski discloses an 

28 apparatus and method for providing synchronization for a transmitted multilayered 

29 compressed video signal by inserting auxiUary transport packets which include modifiable 

30 differential time codes or count values. These differential count values are used to 
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1 account for the incremental delays the transport packets incur during the signal 

2 forming/transmission process. 
3 

4 Summary of the Invention 

5 The present invention may be regarded as a data stream control system 

6 connectable to a storage device, the data stream control system selectively storing a 

7 series of selected data packets from an incoming data transport stream. A transport 

8 stream input interface receives the incoming data transport stream comprising selected 

9 data packets having interpacket time intervals between the selected data packets. A 

10 command interface receives at least one packet filter parameter identifying the series of 

1 1 selected data packets. A programmable data packet fiher is coupled to the command 

12 interface and transport stream input interface and transmits the series of selected data 

13 packets in response to the packet fiher parameter and the incoming data transport 

14 stream. A storage interface is coupled to the programmable data packet fiher and is 

15 connectable to the storage device. The storage interface transmits the selected data 

16 packets to the storage device. A counter provides counter values for the selected data 

17 packets. Each counter value represents a time of reception of a respective selected data 

18 packet. The counter value is stored in association with the respective selected data 

19 packet to preserve information regarding the interpacket time intervals of the series of 

20 selected data packets from the incoming data transport stream. 

21 The present invention may also be regarded as a data storage system that 

22 selectively stores a series of selected data packets from an incoming data transport 

23 stream and that plays back and transmits the stored series of selected data packets to an 

24 outgoing data transport stream. A data storage system controller generates at least one 

25 packet fiher parameter in response to user input. The at least one packet filter parameter 

26 identifies the series of selected data packets. A transport stream input interface receives 

27 the incoming data transport stream comprising selected data packets having interpacket 

28 time intervals between the selected data packets. A command interface receives the at 

29 least one packet fiher parameter from the data storage system controller. A 

30 programmable data packet fiher is coupled to the command interface and transport 

3 1 stream input interface and transmits the series of selected data packets in response to the 
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1 packet filter parameter and the incoming data transport stream. A storage device stores 

2 the selected data packets. A storage interface is coupled to the programmable data 

3 packet filter and to the storage device and transmits the selected data packets to the 

4 storage device and receives stored selected data packets from the storage device, A 

5 counter provides counter values for the selected data packets. Each counter value 

6 represents a time of reception of a respective selected data packet. The counter value is 

7 stored in association with the respective selected data packet to preserve information 

8 regarding the interpacket time intervals of the series of selected data packets fi-om the 

9 incoming data transport stream. A timing restorer receives the stored selected data 

10 packets fi*om the storage interface and receives the counter values stored in association 

11 v^ith the respective selected data packets. The timing restorer transmits the stored 

12 selected data packet at a time of transmission responsive to the respective counter value. 

13 A transport stream output interface is coupled to the timing restorer and the outgoing 

14 data transport stream. The transport stream output interface receives the stored series of 

15 selected data packets from the timing restorer. The outgoing data transport stream 

16 receives the stored series of selected data packets from the transport stream output 

17 interface with interpacket time intervals which substantially match the corresponding 

18 interpacket time intervals of the series of selected data packets firom the incoming data 

19 transport stream. 

20 The present invention may also be regarded as a method of selectively storing a 

21 series of selected data packets fi-om an incoming data transport stream. The series of 

22 selected data packets has interpacket time intervals between the selected data packets. 

23 The method comprises receiving at least one packet filter parameter identifying the series 

24 of selected data packets. The method fiirther comprises receiving the incoming data 

25 transport stream. The method fiirther comprises storing the series of selected data 

26 packets in response to the packet filter parameter and the incoming data transport 

27 stream. The method fiirther comprises providing counter values for the selected data 

28 packets. Each counter value represents a time of reception of a respective selected data 

29 packet. The method fiirther comprises storing the counter value in association with the 

30 respective selected data packet, thereby preserving information regarding the interpacket 
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1 time intervals of the series of selected data packets from the incoming data transport 

2 stream. 

3 The present invention may also be regarded as a method of selectively storing 

4 and playing back a series of selected data packets from an incoming data transport 

5 stream. The series of selected data packets has interpacket time intervals between the 

6 selected data packets. The method comprises receiving at least one packet filter 

7 parameter identifying the series of selected data packets. The method fiirther comprises 

8 receiving the incoming data transport stream. The method further comprises storing the 

9 series of selected data packets in response to the packet filter parameter and the 

10 incoming data transport stream. The method fUrther comprises providing counter values 

1 1 for the selected data packets. Each counter value represents a time of reception of a 

12 respective selected data packet. The method fiirther comprises storing the counter value 

13 in association with the respective selected data packet, thereby preserving information 

14 regarding the interpacket time intervals of the series of selected data packets firom the 

15 incoming data transport stream. The method further comprises playing back the stored 

16 selected data packets. The method further comprises receiving the counter value stored 

17 in association with the respective selected data packets. The method further comprises 

18 transmitting the stored selected data packet at a time of transmission responsive to the 

19 respective counter value. The stored series of selected data packets are transmitted with 

20 interpacket time intervals which substantially match the corresponding interpacket time 

21 intervals of the series of selected data packets from the incoming data transport stream. 
22 

23 Brief Description of the Drawings 

24 Figure 1 schematically illustrates a data storage system comprising a data stream 

25 control system in accordance with an embodiment of the present invention. 

26 Figure 2 is a timing diagram of one embodiment of an MPEG-encoded incoming 

27 data transport stream. 

28 Figure 3 schematically illustrates a data storage system comprising a data stream 

29 control system in accordance with another embodiment of the present invention. 
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1 Figure 4 schematically illustrates a data stream control system in accordance with 

2 an embodiment of the present invention, in which the counter is synchronized to a clock 

3 that provides time information. 

4 Figure 5 schematically illustrates an exemplary series of selected data packets 

5 stored on the storage device. 

6 Figure 6 schematically illustrates a data stream control system in accordance with 

7 an embodiment of the present invention, in which the counter is coupled to the 

8 programmable data packet filter. 

9 Figure 7 schematically illustrates a data stream control system in accordance with 

10 an embodiment of the present invention, in which the timing restorer is synchronized to a 

1 1 clock that provides time information. 

12 Figure 8 schematically illustrates a data stream control system in accordance with 

13 an embodiment of the present invention, in which the timing restorer comprises a null 

14 data packet generator. 

15 Figure 9 is a flowchart which illustrates one embodiment of a method of 

16 selectively storing a series of selected data packets. 

17 Figure 10 is a flowchart which illustrates one embodiment of a method of 

1 8 selectively storing and playing back a stored series of selected data packets. 
19 

20 Detailed Description of an Embodiment 

21 Figure 1 schematically illustrates a data storage system 2 comprising a data 

22 stream control system 10 in accordance with an embodiment of the present invention. 

23 The data stream control system 10 is connectable to a storage device 20 and selectively 

24 stores a series of selected data packets 30 firom an incoming data transport stream 40. 

25 The data stream control system 10 comprises a transport stream input interface 60 that 

26 receives the incoming data transport stream 40 that has interpacket time intervals 

27 between the selected data packets 30. The data stream control system 10 further 

28 comprises a command interface 50 that receives the at least one packet filter parameter 

29 52 identifying the series of selected data packets 30, The data stream control system 10 

30 fLirther comprises a programmable data packet filter 70 coupled to the command 

31 interface 50 and transport stream input interface 60. The programmable data packet 
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1 filter 70 transmits the series of selected data packets 30 in response to the packet filter 

2 parameter 52 and the incoming data transport stream 40. The data stream control 

3 system 10 fiarther comprises a storage interface 80 coupled to the programmable data 

4 packet filter 70 and connectable to the storage device 20. The storage interface 80 

5 transmits the selected data packets 30 to the storage device 20. The data stream control 

6 system 10 further comprises a counter 90 that provides counter values 100 for the 

7 selected data packets 30. Each counter value 100 represents a time of reception of a 

8 respective selected data packet 30. The counter value 100 is stored in association with 

9 the respective selected data packet 30 to preserve information regarding the interpacket 

10 time intervals of the series of selected data packets 30 fi^om the incoming data transport 

11 stream 40. The data storage system 2 comprises a data storage system controller 4 that 

12 generates the at least one packet filter parameter 52 identifying the series of selected data 

13 packets 30. 

14 In certain embodiments of the present invention, the data stream control system 

15 10 is a portion of a data storage system 2 such as a personal video recorder (PVR). In 

16 these embodiments, the data stream control system 10 can be realized as an appUcation- 

17 specific integrated circuit (ASIC) coupled to other components of the PVR 2. Persons 

18 skilled in the art appreciate, however, that the data stream control system 10 described 

19 herein can also be realized as multiple separate components of the PVR 2. Only the 

20 portions of the PVR 2 pertinent to the present invention are illustrated in Figure 1 and 

21 the other figures. One skilled in the art will appreciate that an exemplary PVR 2 has 

22 other elements (not shown) that implement other features of the PVR 2. An exemplary 

23 PVR 2 is disclosed in copending U.S. Patent Application No. 09/585,249, filed May 31, 

24 2000, entitled "Digital Video Recorder Connectable To An AuxiUary Interface Of A Set- 

25 Top Box That Provides Video Data Stream To A Display Device Based On Selection 

26 Between Recorded Video Signal Received From The Digital Video Recorder And A 

27 Real-Time Video Signal," which is incorporated by reference herein. Also, in other 

28 embodiments, the data stream control system 10 can be a portion of other types of data 

29 storage systems, such as personal computers or video camera systems. 

30 The data stream control system 10 is connectable to a storage device 20 which 

31 selectively stores a series of selected data packets 30 fi*om an incoming data transport 
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1 stream 40. In addition, the storage device 20 can provide storage for various types of 

2 system information. In certain embodiments of the present invention, the storage device 

3 20 comprises a hard disk drive compatible with a version of the ATA (AT-attachment) 

4 standard, such as IDE (Integrated Drive Electronics). In other embodiments, the storage 

5 device 20 comprises a hard disk drive compatible with the SCSI (Small Computer 

6 System Interface) standard. In still other embodiments, the storage device 20 comprises 

7 a hard disk drive compatible with the IEEE 1394 standard, which is described in the 

8 "IEEE Std 1394-1995 IEEE Standard for a High Performance Serial Bus" August 30, 

9 1996, which is incorporated by reference herein. A storage device 20 compatible with 

10 the present invention can utilize any technology that provides writable non-volatile 

1 1 storage (e.g., a writable digital video disk (DVD) drive). 

12 In an embodiment in which the data stream control system 10 is a portion of a 

13 PVR 2, the incoming data transport stream 40 is typically generated by a video input 

14 interface in response to an external video data stream received from a video data service 

15 provider that suppUes video programming to multiple users. Examples of such video 

16 data service providers include, but are not limited to, cable television systems and 

17 satellite systems. Alternatively, the external video data stream can be received from 

18 UHF or VHF broadcast signals using an antenna. The incoming data transport stream 40 

19 is generated by the video input interface with a format which is compatible with the other 

20 components of the data storage system. For example, in certain embodiments, to 

21 provide compatibility of the PVR 2 with an analog-formatted external video data stream, 

22 the video input interface of certain embodiments comprises an MPEG (Motion Pictures 

23 Experts Group) encoder, which generates an incoming data transport stream 40 

24 comprising MPEG-encoded data packets in response to the analog-formatted external 

25 video data stream. Alternatively, in other embodiments, the external video data stream 

26 itself comprises MPEG-encoded data packets thereby serving as the incoming data 

27 transport stream 40, which is then transmitted to the data stream control system 10 by 

28 the video input interface. Furthermore, for particular embodiments that are compatible 

29 with an encrypted external video data stream (e.g., video data streams from premium 

30 cable channels), the PVR 2 can also comprise a decrypter, typically as a component of 

3 1 the video input interface. 
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1 The transport stream input interface 60 receives the incoming data transport 

2 stream 40 for the data stream control system 10 and transmits the incoming data 

3 transport stream 40 to the programmable data packet filter 70. Persons skilled in the art 

4 are able to provide a video input interface and a transport stream input interface 60 that 

5 are compatible with the present invention. Note that while the following discussion 

6 focuses on certain embodiments in which the incoming data transfer stream 40 is MPEG- 

7 encoded, other embodiments compatible with the present invention can utilize incoming 

8 data transport streams 40 conforming to other selected compression standards. 

9 In an embodiment in which the data stream control system 10 is a portion of a 

10 PVR 2, the packet filter parameter 52 is typically generated by a system controller in 

1 1 response to user input and/or electronic program guide (EPG) information. A user 

12 provides user input to the PVR to select which video program segments are stored firom 

13 the inconiing data transfer stream 40, as well as to control various other operation 

14 parameters of the PVR 2, such as playback commands (e.g., pause, instant-replay, etc.). 

15 The incoming data transport stream 40 comprises selected data packets 30 

16 corresponding to the video program segments selected to be stored, and non-selected 

17 data packets corresponding to the portion of the incoming data transport stream 40 not 

18 selected for storing. The EPG information is a database, typically displayed to the user 

19 in the form of a program grid, containing information regarding the programs and 

20 broadcast schedules fi-om various broadcast channels. The user input, in conjunction 

21 with the EPG information, is used by the system controller to generate at least one 

22 packet filter parameter 52 which indicates the series of selected data packets 30 

23 corresponding to the video program segment selected for storing. The packet fiher 

24 parameter 52 is then transmitted to the command interface 50 of the data stream control 

25 system 10. 

26 In embodiments in which the incoming data transport stream 40 comprises 

27 multiple series of MPEG-encoded data packets, the packet filter parameter 52 comprises 

28 the packet identifier code (PID) which is contained in the header of each selected data 

29 packet 30. Each MPEG-encoded data packet contains 188 bytes, comprising a header 

30 with a minimum size of 4 bytes, and a payload which comprises the encoded data. The 

3 1 header comprises the PID and the program clock reference (PGR) for the particular data 
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1 packet. As described above, an MPEG decoder relies on the PGR value to properly 

2 synchronize its system time clock (STC) to the STC of the MPEG encoder. Under the 

3 MPEG encoding standard, in a given transport stream, MPEG-encoded data packets 

4 belonging to a given elementary stream (i.e., generated by the same MPEG encoder) will 

5 have the same PID. Packets in another elementary stream will have another PID. In this 

6 way, a decoder or demultiplexer can select the elementary stream it wants from a 

7 transport stream and reject the remainder. Under the MPEG standard, the PK) is a 

8 thirteen-bit code which distinguishes the various data packets. For example, null data 

9 packets all have the same PED, which is 8191, or thirteen Ts, Persons skilled in the art 

10 appreciate that other encoding or compression standards with other packet identification 

1 1 means are compatible with the present invention. 

12 Figure 2 is a timing diagram of one possible embodiment of an MPEG-encoded 

13 incoming data transport stream 40 comprising audiovisual (AV) program data segments 

14 AVI and AV2, information technology (IT) data segments ITl and IT2, and null data 

15 packets. Null data packets are typically part of an incoming data transport stream 40 in 

16 which the fijU bandwidth of the incoming data transport stream 40 is not being utilized by 

17 the video data streams being transmitted. As a result, an incoming data transport stream 

18 40 which contains video data streams being transmitted with reduced resolution, and 

19 hence requiring less bandwidth, will generally incorporate more null data packets. The 

20 horizontal axis of Figure 2 corresponds to time, with increasing elapsed time firom left to 

21 right. In the following discussion, the series of AVI data packets (AVl-1, AVl-2, ...) 

22 represents the series of selected data packets 30 corresponding to the video program 

23 segment selected for storing to better illustrate the operation of the data stream control 

24 system 10. The AVI series of selected data packets 30 has interpacket time intervals 

25 between the various AVI data packets. Under one convention of expressing the 

26 interpacket time intervals, an interpacket time interval is defined as the time interval 

27 between the time of reception of the sync reference of a first selected data packet and the 

28 time of reception of the sync reference of a second selected data packet. Typically, the 

29 sync reference is the first byte of each data packet; however, any portion of the data 

30 packets may be selected as the sync reference as long as the selection is consistent for all 

3 1 data packets. For example, the interpacket time interval between selected data packets 
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1 AVl-1 and AVI -2 is (t2-ti), where ti and are the times of reception of the sync 

2 references of the AVl-1 and AVl-2 selected data packets, respectively. 

3 As seen in Figure 1, these interpacket time intervals comprise one selected data 

4 packet, non-selected data packets (i.e., AV2, ITl, IT2, null) and/or time periods with no 

5 data packets (denoted in Figure 2 as an ellipsis). For example, the interpacket time 

6 interval between times ti and t2 comprises the AVl-1 selected data packet and the AV2, 

7 ITl, and IT2 non-selected data packets. The interpacket time interval between times ts 

8 and U comprises the AVl-3 selected data packet, an AV2 non-selected data packet, and 

9 a time period with no data packets. Note that for selected data packets which 

10 immediately precede one another (e.g., selected data packets AVl-4 and AVl-5), the 

1 1 corresponding interpacket time interval between times t4 and X% comprises one selected 

12 data packet (e.g., AVl-4). Accordingly, another convention can express the interpacket 

13 time intervals in terms of a number of non-selected data packets interposed between a 

14 first selected data packet and a second selected data packet. For example, the 

15 interpacket time interval between times ti and t2 can be expressed as three non-selected 

16 data packets, and the interpacket time interval between times U and Xs can be expressed 

17 as zero. Persons skilled in the art appreciate that various conventions for expressing the 

18 interpacket time intervals are compatible with the present invention. 

19 The incoming data transport stream 40 and the packet filter parameter 52 are 

20 received by the programmable data packet filter 70, which transmits the series of selected 

21 data packets 30 in response to the packet filter parameter 52 and the incoming data 

22 transport stream 40, For the incoming data transport stream 40 illustrated in Figure 2, 

23 the progranmiable data packet filter 70 receives the selected data packets 30 (i.e., AVl- 

24 1, AVI -2, . . .) at times ti, t2, ... and the interpacket time intervals between the selected 

25 data packets 30 comprise the non-selected data packets. In certain embodiments, the 

26 programmable data packet filter 70 comprises a demultiplexer which transmits the series 

27 of selected data packets 30 to the storage interface 80, but does not transmit the non- 
28 selected data packets. For the incoming data transport stream 40 illustrated in Figure 2, 

29 the programmable data packet filter 70 transmits the AVI series of selected data packets 

30 30 but does not transmit the AV2, ITl, IT2, or null data packets. Furthermore, in 
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1 certain embodiments as described below, the programmable data packet filter 70 detects 

2 non-selected data packets and generates a corresponding signal 

3 The storage interface 80 is coupled to the programmable data packet filter 70 and 

4 is connectable to the storage device 20. The storage interface 80 transmits the selected 

5 data packets 30 to the storage device 20. As is more fiilly described in the following 

6 discussion of various embodiments, the storage interface 80 can comprise various 

7 memory buffers to facilitate the transfer of selected data packets and other information 

8 between the data stream control system 10 and the storage device 20. In certain 

9 embodiments, the storage interface 80 can also be coupled to other memory buffers (e.g., 

10 random-access memory (RAM)) to store various information such as the counter values 

1 1 100. Persons skilled in the art are able to provide a storage interface 80 compatible with 

12 the present invention. 

13 The counter 90 provides counter values 100 for the selected data packets 30. 

14 Each counter value 100 represents a time of reception of a respective selected data 

15 packet 30. In one embodiment, the time of reception of a data packet is a time at which 

16 the data packet is received by the programmable data packet filter 70. In other 

17 embodiments, the time of reception can be the time at which the data packet is received 

18 by another component of the data storage system 2, as long as the time of reception is 

19 consistently defined for all data packets. As is more My described in the following 

20 discussion of various embodiments, the counter values 100 can represent the times of 

21 reception of the selected data packets 30 in numerous forms. In addition, in these 

22 various embodiments, the counter 90 can be coupled with various other components of 

23 the data stream control system 10 in order to provide counter values 100 compatible 

24 with the present invention. As illustrated in Figure 1, two of these optional couplings are 

25 represented by the dashed line between the counter 90 and the programmable data 

26 packet filter 70 and the dashed line between the counter 90 and the transport stream 

27 input interface 60. Persons skilled in the art appreciate that other embodiments can 

28 utilize alternative couplings of the counter 90 which are compatible with the present 

29 invention, 

30 The counter values 100 are stored in association with the respective selected data 

31 packets 30 to preserve information regarding the interpacket time intervals of the series 
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1 of selected data packets 30 from the incoming data transport stream 40. As is described 

2 more My below, certain embodiments can append the counter values 100 to the 

3 selected data packets 30, storing both on the storage device 20, Alternatively, in other 

4 embodiments, the counter values 100 can be stored on a memory buflfer separate from 

5 the storage drive 20 in a memory location indexed to the respective selected data packet 

6 30. 

7 Figure 3 schematically illustrates a data storage system 2 comprising an 

8 embodiment of the data stream control system 10 in which the storage interface 80 

9 receives stored selected data packets 110 from the storage device 20, and the storage 

10 device 20 plays back and transmits the stored series of selected data packets 110. In this 

11 embodiment, the data stream control system 10 fiirther comprises a timing restorer 120 

12 that receives the stored selected data packets 110 from the storage interface 80 and that 

13 receives the counter value 130 stored in association with the respective selected data 

14 packets 110, The timing restorer 120 transmits the stored selected data packet 110 at a 

15 time of transmission responsive to the respective counter value 130. The data stream 

16 control system 10 illustrated in Figure 3 further comprises a transport stream output 

17 interface 140 coupled to the timing restorer 120 and an outgoing data transport stream 

18 150. The transport stream output interface 140 receives the stored series of selected 

19 data packets 1 10 from the timing restorer 120 and transmits the stored series of selected 

20 data packets 110 to the outgoing data transport stream 150. The stored series of 

21 selected data packets 110 transmitted to the outgoing data transport stream 150 has 

22 interpacket time intervals which substantially match the corresponding interpacket time 

23 intervals of the series of selected data packets from the incoming data transport stream. 

24 As is described more fiiUy in the following discussion of various embodiments, 

25 various configurations of the timing restorer 120 can utilize the stored counter values 

26 130 to substantially match the interpacket time intervals of the corresponding series of 

27 selected data packets. In certain embodiments, by transmitting a stored selected data 

28 packet 110 in response to the respective stored counter value 130, the timing restorer 

29 120 can substantially restore the interpacket time intervals which existed between the 

30 corresponding selected data packets 30 as they were received by the programmable data 

31 packet filter 70. Alternatively, in other embodiments, the timing restorer 120 can 
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1 substantially restore the interpacket time intervals by inserting null data packets between 

2 the stored selected data packets 110 in response to the respective stored counter value 

3 130. In the various embodiments, the interpacket time intervals of the series of selected 

4 data packets 30 are substantially matched or restored when the stored selected data 

5 packets 110 have interpacket time intervals which match the interpacket time intervals of 

6 the corresponding selected data packets 30 to within approximately one clock cycle. 

7 The transport stream output interface 140 receives the stored series of selected 

8 data packets 110 with interpacket time intervals which substantially match those of the 

9 corresponding series of selected data packets and transmits the stored series of selected 

10 data packets 110 to the outgoing data transport stream 150. In certain embodiments in 

11 which the data stream control system 10 is a portion of a PVR, the outgoing data 

12 transport stream 150 transmitted from the data stream control system 10 is received by 

13 an MPEG decoder which in response generates an audiovisual data stream which is 

14 displayed on a display device, such as a television. In this way, the data stream control 

15 system 10 enables a PVR user to view a previously stored video data segment. Persons 

16 skilled in the art are able to provide a transport stream output interface 140 that is 

17 compatible with the present invention. 

18 As described above, MPEG decoding requires that the interpacket time intervals 

19 of the series of selected data packets 30 be preserved because an MPEG decoder utilizes 

20 the PGR values of the selected data packet 30 to synchronize its STC with the STC of 

21 the MPEG encoder. Normally, when a series of selected data packets 30 from an 

22 incoming data transport stream 40 is stored on a storage device 20, the selected data 

23 packets 30 are collected in a memory buffer and then burst out to the media within the 

24 storage device 20. This procedure removes any information regarding the interpacket 

25 time intervals of the series of selected data packets 30 that was present in the incoming 

26 data transport stream 40. Consequently, the PGR timing for MPEG encoding and 

27 decoding is therefore compromised. However, by storing the counter values 100 

28 representing the times of reception in association with the selected data packets 30, the 

29 data stream control system 10 compatible with the present invention preserves 

30 information regarding the interpacket time intervals of the series of selected data packets 

31 30 from the incoming data transport stream 40. Also, by not storing the non-selected 
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1 data packets and the time periods without data packets, this use of counter values 100 

2 stored in association with the selected data packet 30 can further reduce the total amount 

3 of storage space required. Persons skilled in the art recognize that in certain 

4 embodiments, this preservation of information regarding the interpacket time interval can 

5 find utility with data streams which are encoded according to other selected compression 

6 standards. 

7 In the embodiment of the data stream control system 10 illustrated in Figure 4, 

8 the data stream control system 10 further comprises a clock 160, and the storage 

9 interface 80 further comprises a storage memory buflfer 170 and a playback memory 

10 buffer 180. The clock 160 is coupled to the counter 90 and provides time information in 

11 the form of a clock value 190. In this way, the counter 90 is synchronized to the clock 

12 160. In addition, the counter 90 of the embodiment illustrated in Figure 4 is coupled to 

13 the programmable data packet filter 70. Note that in alternative embodiments, the 

14 counter 90 need not be coupled to the programmable data packet fiher 70. The clock 

15 160 illustrated in Figure 4 is a separate component of the data stream control system 10; 

16 however, in other embodiments, the clock 160 can be a sub-component of the counter 

17 90, system controller, or other component of the data stream control system 10. In 

18 certain other embodiments, the clock 160 can be external to the data stream control 

19 system 10. 

20 The programmed data packet filter 70 of the embodiment illustrated in Figure 4 

21 sends a signal to the counter 90 upon receiving a selected data packet 30. In response to 

22 this signal, the counter 90 determines the time of reception by the programmed data 

23 packet filter 70 of the selected data packet 30 by noting the clock value 190 from the 

24 clock 160. As described below, different embodiments of the present invention can 

25 express this time of reception of the selected data packet 30 in different forms. 

26 In certain embodiments, the counter value 100 corresponding to the selected data 

27 packet 30 represents a time interval expressed as an absolute clock value 190 in relation 

28 to a reference time, such as the time to of a previous reset of the clock 160. For 

29 example, referring to Figure 2, the time of reception ti by the programmable data packet 

30 filter 70 of the selected AVl-1 data packet would be represented by a counter value of 

3 1 (ti-to), the time of reception t2 by the programmable data packet filter 70 of the selected 
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1 AVl-2 data packet would be represented by a counter value of (t2-to), and so on. The 

2 selected data packet 30 and its associated counter value 100 are then transmitted by the 

3 programmable data packet filter 70 and the counter 90 to the storage memory buffer 

4 170. 

5 Alternatively, in other embodiments, the counter value 100 corresponding to the 

6 selected data packet 30 represents a time interval expressed as a differential clock value 

7 190 in relation to a reference time, such as the time of reception of an earlier selected 

8 data packet 30. For example, referring to Figure 2, where the reference time is the time 

9 of reception ti of the selected AVl-1 data packet, the selected AVl-1 data packet would 

10 be associated with a counter value of (ti-ti)=0, the selected AVI -2 data packet detected 

11 at t2 would be associated with a counter value of (t2-ti), the selected AVI -3 data packet 

12 detected at ts would be associated with a counter value of (ts-ti), and so on. Where the 

13 reference time is the time of reception of the immediately preceding selected data packet 

14 30, the selected AVl-2 data packet would be associated with a counter value of (t2-ti), 

15 the selected AVI -3 data packet detected at ts would be associated with a counter value 

16 of (t3-t2), and so on. The selected data packet 30 and its associated counter value 100 

17 are then transmitted by the progranmiable data packet filter 70 and the counter 90 to the 

1 8 storage memory buffer 1 70. 

19 Note that where a second selected data packet immediately follows another with 

20 no intervening time or non-selected data packets (e.g., selected data packets AVl-4 and 

21 AVl-5 in Figure 2), the interpacket time interval is the time corresponding to a single 

22 selected data packet. In certain embodiments of the present invention, this time 

23 corresponding to a single selected data packet can be implicit in the counter values, so 

24 that the corresponding counter value can be expressed as zero. Alternatively, in other 

25 embodiments of the present invention, the second of these selected data packets may not 

26 have a counter value associated with it. Instead, a flag or other form of indication may 

27 be used to denote two adjacent selected data packets with no intervening time or non- 
28 selected data packets. Persons skilled in the art will appreciate that such an embodiment 

29 is compatible with the present invention. 

30 The storage memory buffer 170 continuously transfers selected data packets 30 

3 1 from the data stream control system 10 to the storage device 20. Similarly, the playback 
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1 memory buffer 180 continuously transfers stored selected data packets 110 from the 

2 storage device 20 to the data stream control system 10. Data streaming rates for 

3 continuously streaming video data (e.g., 1 Mb/s) are typically much lower than the 

4 instantaneous data transfer rates for transferring data packets from storage devices 20 

5 comprising hard disk drives (e.g., 66 Mb/s). The storage memory buffer 170 and the 

6 playback memory buffer 180 thus serve as temporary repositories of selected data 

7 packets in order to maintain a data streaming rate that is lovv^er than the instantaneous 

8 data transfer rate of the storage device 20. Similar memory buffers are described in U.S. 

9 Patent Application No. 09/628,583, filed July 31, 2000, entitled "Video Recording 

10 System Utilizing Host-Processor-Resident Error Recovery To Transfer Non-Time- 

11 Critical, Error-Intolerant Data Segments While Transferring Time-Critical, Error- 

12 Tolerant Streaming Data Segments At A Required Data Transfer Rate," which is 

1 3 incorporated by reference herein. 

14 From the storage memory buffer 170, the selected data packets 30 are 

15 transmitted to the storage device 20, where they are stored for playback upon 

16 appropriate commands from the data stream control system 10. In addition, the 

17 corresponding counter values 100 are directed by the storage interface 80 to be stored in 

18 association with the selected data packets 30. In the embodiment of the data stream 

19 control system 10 illustrated in Figure 4, the selected data packets 30 and the respective 

20 counter values 100 are both transmitted to the storage device 20. A storage interface 80 

21 compatible with this embodiment can comprise a multiplexer to combine the selected 

22 data packets 30 with the respective counter values 100 which are both then stored on the 

23 storage device 20. In certain embodiments compatible with MPEG-encoded selected 

24 data packets 30, an MPEG-encoded selected data packet is appended with a 

25 corresponding counter value representing the time of reception of the selected data 

26 packet, and both the selected data packet and the counter value are stored on the storage 

27 device 20. Figure 5 schematically illustrates an exemplary series of selected data packets 

28 110 stored with the corresponding counter values 130 by the storage device 20, the 

29 selected data packets corresponding to the video program segment AVI of Figure 2. In 

30 certain embodiments of the present invention, the counter value 130 is a 4-byte value 

3 1 appended to the front end of the 188-byte selected data packet 110. Figure 5 illustrates 
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1 an embodiment in which the counter value 130 stored with the stored selected data 

2 packet 1 10 is expressed as an absolute clock value 190 in relation to a reference time to, 

3 although other embodiments are also compatible with the present invention. Note that 

4 embodiments which store the counter values 130 on a memory buffer or RAM at a 

5 memory location indexed to the respective stored selected data packet 110, and not with 

6 the respective stored selected data packets 110 on the storage device 20, are also 

7 compatible with the present invention. 

8 In embodiments in which the interpacket time intervals of the series of selected 

9 data packets 30 are completely filled with non-selected data packets, the data stream 

10 control system 10 schematically illustrated in Figure 6 can be used. In this embodiment, 

1 1 the counter 90 is coupled to the programmable data packet filter 70, which detects non- 
12 selected data packets, i.e., those data packets which do not correspond to the selected 

13 video program segments, and transmits a series of signals 200 to the counter 90, each 

14 signal 200 denoting the detection of a non-selected data packet. By counting the number 

15 of such signals 200 preceding a selected data packet 30 since receiving a previously 

16 received selected data packet 30, the counter 90 can determine the time of reception of 

17 the selected data packet 30. The counter 90 then generates a counter value 100 which 

18 comprises a non-selected packet count associated with the selected data packet 30. For 

19 example, referring to Figure 2, the AVI -2 selected data packet would be associated with 

20 a counter value of 3, which represents the number of non-selected data packets detected 

21 since the time of reception of the AVl-1 selected data packet, the AVI -3 selected data 

22 packet would be associated with a counter value of 2, which represents the number of 

23 non-selected data packets detected since the time of reception of the AVI -2 selected 

24 data packet, and so on, 

25 Alternatively, in other embodiments, the programmable data packet filter 70 

26 detects every data packet, both selected data packets 30 and non-selected data packets, 

27 and transmits a series of signals to the counter 90, each signal denoting the detection of a 

28 data packet. By generating a counter value 100 which corresponds to a continual count 

29 of the number of data packets, the counter 90 can express the time of reception for a 

30 selected data packet 30 as the ordinal number of the selected data packet 30 in the 

3 1 incoming data transport stream 40. For example, referring to Figure 2, where the ordinal 
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1 number of the AVl-1 selected data packet in the incoming data transport stream is Ni, 

2 the AVI -2 selected data packet would be associated with a counter value of N2=(Ni+4) 

3 which is the ordinal number of the AVI -2 selected data packet, the AVI -3 selected data 

4 packet would be associated with a counter value of N3^(Ni+7), which represents the 

5 ordinal number of the AVl-3 selected data packet, and so on. Similarly, in still other 

6 embodiments, the counter value 100 can express the time of reception of a selected data 

7 packet 30 as a difference of the ordinal numbers from two sequential selected data 

8 packets 30. In each of these embodiments, the counter 90 generates a counter value 100 

9 which comprises a non-selected packet count associated with the selected data packet 

10 30, The selected data packet 30 with its respective counter value 100 is then transmitted 

11 by the programmable data packet filter 70 and the counter 90 to the storage memory 

12 buffer 100. Note that embodiments which utilize the non-selected packet count as a 

13 measure of the time of reception would not provide an accurate measure of interpacket 

14 time intervals which are not fiilly filled with non-selected data packets, such as the time 

15 interval between the AVl-3 selected data packet and the AVl-4 selected data packet, as 

1 6 illustrated in Figure 2 . 

17 To playback a stored series of selected data packets 1 10, the data stream control 

18 system 10 transmits the stored series of selected data packets 110 to the outgoing data 

19 transport stream 150. In the embodiment schematically illustrated in Figure 7, the stored 

20 selected data packets 110 and the corresponding counter values 130 are transmitted by 

21 the storage device 20 to the playback memory buffer 180, which then transmits the 

22 stored selected data packets 110 and corresponding counter values 130 to the timing 

23 restorer 120. Alternatively, in other embodiments in which the counter values 130 are 

24 stored in another memory buffer or RAM, the storage interface 80 receives the counter 

25 values 130 from the memory buffer or RAM and transmits the counter values 130 to the 

26 timing restorer 120. 

27 Upon receiving the stored selected data packet 110 with its corresponding 

28 counter value 130, the timing restorer 120 transmits the stored selected data packet 110 

29 to the transport stream output interface 140 at a time of transmission responsive to the 

30 counter value 130 of the stored selected data packet 110. In embodiments in which the 

3 1 stored selected data packets 110 have been combined with the respective counter values 



Y:\K35A\A0600-A0699\A0691\DOCS\k35a0691paf.doc 12/20/00 



19 



PATENT 

ATTY DOCKET K35A0691 

1 130, the timing restorer 120 can comprise a demultiplexer to separate the stored selected 

2 data packets 110 from the counter values 130. In certain embodiments, the timing 

3 restorer 120 is synchronized to a clock 210, which provides time information which is 

4 used to determine the time of transmission for the stored selected data packet 110. In 

5 certain embodiments of the present invention, the timing restorer 120 is synchronized to 

6 the same clock 160 to which the counter 90 is synchronized. In certain other 

7 embodiments, the timing restorer 120 can be synchronized to a different clock 210. The 

8 clock 210 illustrated in Figure 7 is a separate component of the data stream control 

9 system 10; however, in other embodiments, the clock 210 can be a sub-component of the 

10 timing restorer 120, system controller, or other component of the data stream control 

11 system 10. In certain other embodiments, the clock 210 can be external to the data 

12 stream control system 10. 

13 In embodiments in which the timing restorer 120 is synchronized to a clock 210, 

14 the time of transmission of a stored selected data packet 110 can be referenced to a 

15 reference time. By monitoring a clock value 220 from the clock 210, the timing restorer 

16 120 can determine the appropriate time of transmission of the stored selected data packet 

17 110 in response to the corresponding counter value 130. In certain embodiments, the 

1 8 time of transmission is determined in relation to an absolute reference time, which can be 

19 the time of a previous reset of the clock 210. Alternatively, in other embodiments 

20 utilizing a differential reference time, the reference time can be the time of transmission 

21 for an earlier stored selected data packet 130. For example, referring to the stored 

22 selected data packets 130 as illustrated in Figure 5, where the time of transmission of the 

23 AVl-1 stored selected data packet was xi, the time of transmission T2 for the AVI -2 

24 stored selected data packet would be Ti+(t2-ti), the time of transmission 13 for the AVl-3 

25 stored selected data packet would be Ti+(t3-ti), and so on. Similarly, if the counter value 

26 130 of the stored selected data packet 110 represents the time of reception as the 

27 number of non-selected data packets or the ordinal number of the stored selected data 

28 packet, the timing restorer 120 can calculate the appropriate time of transmission and 

29 transmit the stored selected data packet 110 accordingly. Irrespective of the form in 

30 which the counter values 130 represent the times of reception, the stored series of 

31 selected data packets 110 are transmitted to the transport stream output interface 140 
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1 with interpacket time intervals which substantially match the corresponding interpacket 

2 time intervals of the series of selected data packets from the incoming data transport 

3 stream 40, 

4 In certain other embodiments, such as that illustrated in Figure 8, the timing 

5 restorer 120 interposes a number of null data packets between the stored selected data 

6 packet 1 10 and a previously transmitted stored selected data packet 1 10. The number of 

7 interposed null data packets is responsive to the counter value 130 of the stored selected 

8 data packet 110. In the embodiment schematically illustrated in Figure 8, the timing 

9 restorer 120 comprises a null data packet generator 230 which produces null data 

10 packets in response to the counter values 130. In embodiments in which the counter 

11 value 130 represents the time of reception for a selected data packet as the number of 

12 non-selected data packets detected since receiving the immediately preceding selected 

13 data packet, the number of interposed null data packets between the corresponding 

14 stored selected data packets 110 equals the number of non-selected data packets. 

15 Alternatively, in embodiments in which the counter value 130 represents the times of 

16 reception as either absolute or differential clock values, the number of interposed null 

17 data packets is chosen to substantially match the interpacket time intervals for the 

18 corresponding series of selected data packets. Irrespective of the form in which the 

19 counter value 130 represents the times of reception, the stored series of selected data 

20 packets 1 10 are transmitted to the transport stream output interface 140 with interpacket 

21 time intervals which substantially match the corresponding interpacket time intervals of 

22 the series of selected data packets from the incoming data transport stream 40, 

23 Figure 9 is a flowchart which illustrates one embodiment of a method 300 of 

24 selectively storing a series of selected data packets 30 from an incoming data transport 

25 stream 40 comprising selected data packets 30 and non-selected data packets. The series 

26 of selected data packets 30 has interpacket time intervals between the selected data 

27 packets 30. The method 300 illustrated in Figure 9 is discussed below primarily in 

28 reference to the embodiment of the data stream control system 10 schematically 

29 illustrated in Figure 1. Persons skilled in the art appreciate that while the flowchart 

30 illustrated in Figure 9 presents the procedural blocks in a particular sequence, other 
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1 embodiments with other sequences of the procedural blocks are compatible with the 

2 present invention. 

3 As shown in Figure 9, the method 300 comprises a procedure block 3 10 which 

4 comprises receiving at least one packet filter parameter 52 identifying the series of 

5 selected data packets 30 corresponding to the video program segment selected for 

6 storing. As described above, the packet filter parameter 52 is typically generated by a 

7 system controller in response to user input and/or EPG information. 

8 The method 300 fiarther comprises a procedure block 320 which comprises 

9 receiving the incoming data transport stream 40. As described above, in certain 

10 embodiments, the incoming data transport stream 40 is generated by the video input 

11 interface in response to an external video data stream. Alternatively in other 

12 embodiments, the incoming data transport stream 40 is generated by the system 

13 controller, or by some other device upstream of the data stream control system 10. 

14 The method 300 fiirther comprises a procedure block 330 which comprises 

15 storing the series of selected data packets 30 in response to the packet filter parameter 

16 52 and the incoming data transport stream 40. As described above, the series of selected 

17 data packets 30 is stored on the storage device 20 by transmitting the selected data 

18 packets 30 firom the programmable data packet filter 70 to the storage interface 80, and 

19 the storage interface 80 transmits the selected data packets 30 to the storage device 20. 

20 In certain embodiments, the selected data packets 30 are transmitted to the storage 

21 device 20 via a storage memory buffer 170. 

22 The method 300 fixrther comprises a procedure block 340 which comprises 

23 providing a counter value 100 for the selected data packets 30. Each counter value 100 

24 represents a time of reception of the selected data packet 30. As described above, in 

25 certain embodiments, the counter value 100 for a selected data packet 30 corresponds to 

26 a time interval between the time of reception of the selected data packet 30 and a 

27 reference time. This reference time can represent a time of a previous reset of a clock, 

28 or a time of reception for an earher selected data packet 30. In addition, in certain 

29 embodiments, the reference time can represent a time of reception for an immediately 

30 preceding selected data packet 30. Alternatively, in other embodiments, the time of 
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1 reception of the selected data packet 30 can be expressed as a number of non-selected 

2 data packets between the selected data packets 30. 

3 The method 300 further comprises a procedure block 350 which comprises 

4 storing the counter value 100 in association with the respective selected data packet 30, 

5 In this way, information regarding interpacket time intervals of the series of selected data 

6 packets 30 from the incoming data transport stream 40 is preserved. As described 

7 above, in certain embodiments, the counter values 100 are stored with the selected data 

8 packets 30 on the storage device 20. Alternatively, in other embodiments, the counter 

9 values 100 are stored elsewhere, but are indexed to be associated with the respective 

10 selected data packets 30. 

11 Figure 10 is a flowchart which illustrates one embodiment of a method 400 of 

12 selectively storing and playing back a series of selected data packets 30 from an 

13 incoming data transport stream 40 comprising selected data packets 30 and non-selected 

14 data packets. The series of selected data packets 30 has interpacket time intervals 

15 between the selected data packets 30. The method 400 illustrated in Figure 10 is 

16 discussed below primarily in reference to the embodiment of the data stream control 

17 system 10 schematically illustrated in Figure 3, Persons skilled in the art appreciate that 

18 while the flowchart illustrated in Figure 10 presents the procedural blocks in a particular 

19 sequence, other embodiments with other sequences of the procedural blocks are 

20 compatible v^th the present invention. 

21 As shown in Figure 10, the method 400 comprises a procedure block 410 which 

22 comprises receiving at least one packet filter parameter 52 identifying the series of 

23 selected data packets, a procedure block 420 which comprises receiving the incoming 

24 data transport stream 40, a procedure block 430 which comprises storing the series of 

25 selected data packets 30, a procedure block 440 which comprises providing a counter 

26 value 100 for the selected data packets 30, and a procedure block 450 which comprises 

27 storing the counter value 100 in association with the respective selected data packet 30. 

28 These procedure blocks 410, 420, 430, 440, and 450 mirror the procedure blocks 310, 

29 320, 330, 340, and 350 described above and schematically illustrated in Figure 9, 

30 The method 400 further comprises a procedure block 460 which comprises 

31 playing back the stored selected data packets 110, As described above, to playback the 
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1 stored series of selected data packets 110, the stored selected data packets 110 are 

2 transmitted from the storage device 20 to the storage interface 80. The storage interface 

3 80 transmits the stored selected data packets 110 to the timing restorer 120. In certain 

4 embodiments, the stored selected data packets 110 are transmitted to the timing restorer 

5 120 via a playback memory buffer 1 80. 

6 The method 400 fiarther comprises a procedure block 470 which comprises 

7 receiving the counter value 130 stored in association with the respective selected data 

8 packets 110. As described above, in certain embodiments which store the counter values 

9 130 with the stored selected data packets 110 on the storage device 20, the counter 

10 values are transmitted from the storage device 20 to the timing restorer 120 via the 

1 1 storage interface 80. Alternatively, in embodiments in which the counter values 130 are 

12 stored elsewhere, but in association with the respective selected data packets 110, the 

13 counter values 130 are transmitted from the memory buffer or RAM from which they are 

14 stored via the storage interface 80 to the timing restorer 120. 

15 The method 400 further comprises a procedure block 480 which comprises 

16 transmitting the stored selected data packet 110 at a time of transmission responsive to 

17 the respective counter value 130. As described above, the stored series of selected data 

1 8 packets 1 10 are transmitted with interpacket time intervals which substantially match the 

19 corresponding interpacket time intervals of the series of selected data packets from the 

20 incoming data transport stream 40. 
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